Skip to content

Update task naming in gradle files PT 4 #9640

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open

Update task naming in gradle files PT 4 #9640

wants to merge 7 commits into from
+155 −122

Conversation

sarahchen6
Copy link
Contributor

What Does This Do

Update instrumentation gradle file tasks to use lazy API formatting.

Motivation

Build improvements

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Sep 30, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Sep 30, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 87.83% (+28.12%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: fb58abe | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 30, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759855769 1759860150
git_commit_sha 2aad71f fb58abe
release_version 1.55.0-SNAPSHOT~2aad71fc17 1.54.0-SNAPSHOT~fb58abe9c7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759862112 1759862112
ci_job_id 1167874586 1167874586
ci_pipeline_id 78635384 78635384
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-mhrc04hj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-mhrc04hj 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 4 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020237
Total [baseline] (10.677 s) : 0, 10677367
Agent [candidate] (1.028 s) : 0, 1027796
Total [candidate] (10.724 s) : 0, 10724298
section appsec
Agent [baseline] (1.202 s) : 0, 1202004
Total [baseline] (11.014 s) : 0, 11014455
Agent [candidate] (1.195 s) : 0, 1195139
Total [candidate] (11.071 s) : 0, 11070868
section iast
Agent [baseline] (1.163 s) : 0, 1162774
Total [baseline] (11.064 s) : 0, 11064489
Agent [candidate] (1.149 s) : 0, 1148657
Total [candidate] (10.997 s) : 0, 10997421
section profiling
Agent [baseline] (1.16 s) : 0, 1160497
Total [baseline] (11.046 s) : 0, 11045747
Agent [candidate] (1.17 s) : 0, 1170202
Total [candidate] (11.089 s) : 0, 11088832
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.202 s 181.767 ms (17.8%)
Agent iast 1.163 s 142.538 ms (14.0%)
Agent profiling 1.16 s 140.26 ms (13.7%)
Total tracing 10.677 s -
Total appsec 11.014 s 337.088 ms (3.2%)
Total iast 11.064 s 387.122 ms (3.6%)
Total profiling 11.046 s 368.38 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.028 s -
Agent appsec 1.195 s 167.343 ms (16.3%)
Agent iast 1.149 s 120.861 ms (11.8%)
Agent profiling 1.17 s 142.406 ms (13.9%)
Total tracing 10.724 s -
Total appsec 11.071 s 346.57 ms (3.2%)
Total iast 10.997 s 273.123 ms (2.5%)
Total profiling 11.089 s 364.534 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.489 ms) : 0, 1489
BytebuddyAgent [baseline] (696.607 ms) : 0, 696607
BytebuddyAgent [candidate] (700.216 ms) : 0, 700216
GlobalTracer [baseline] (241.032 ms) : 0, 241032
GlobalTracer [candidate] (243.667 ms) : 0, 243667
AppSec [baseline] (32.76 ms) : 0, 32760
AppSec [candidate] (33.262 ms) : 0, 33262
Debugger [baseline] (6.43 ms) : 0, 6430
Debugger [candidate] (6.537 ms) : 0, 6537
Remote Config [baseline] (690.156 µs) : 0, 690
Remote Config [candidate] (689.928 µs) : 0, 690
Telemetry [baseline] (9.274 ms) : 0, 9274
Telemetry [candidate] (9.356 ms) : 0, 9356
Flare Poller [baseline] (10.841 ms) : 0, 10841
Flare Poller [candidate] (11.397 ms) : 0, 11397
section appsec
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (723.458 ms) : 0, 723458
BytebuddyAgent [candidate] (718.392 ms) : 0, 718392
GlobalTracer [baseline] (236.205 ms) : 0, 236205
GlobalTracer [candidate] (234.76 ms) : 0, 234760
AppSec [baseline] (175.669 ms) : 0, 175669
AppSec [candidate] (175.364 ms) : 0, 175364
Debugger [baseline] (6.099 ms) : 0, 6099
Debugger [candidate] (6.158 ms) : 0, 6158
Remote Config [baseline] (648.113 µs) : 0, 648
Remote Config [candidate] (656.689 µs) : 0, 657
Telemetry [baseline] (8.482 ms) : 0, 8482
Telemetry [candidate] (8.473 ms) : 0, 8473
Flare Poller [baseline] (4.007 ms) : 0, 4007
Flare Poller [candidate] (3.965 ms) : 0, 3965
IAST [baseline] (24.827 ms) : 0, 24827
IAST [candidate] (24.857 ms) : 0, 24857
section iast
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (822.976 ms) : 0, 822976
BytebuddyAgent [candidate] (813.162 ms) : 0, 813162
GlobalTracer [baseline] (234.116 ms) : 0, 234116
GlobalTracer [candidate] (231.446 ms) : 0, 231446
AppSec [baseline] (36.027 ms) : 0, 36027
AppSec [candidate] (35.196 ms) : 0, 35196
Debugger [baseline] (6.209 ms) : 0, 6209
Debugger [candidate] (6.196 ms) : 0, 6196
Remote Config [baseline] (625.148 µs) : 0, 625
Remote Config [candidate] (609.354 µs) : 0, 609
Telemetry [baseline] (8.774 ms) : 0, 8774
Telemetry [candidate] (8.667 ms) : 0, 8667
Flare Poller [baseline] (4.224 ms) : 0, 4224
Flare Poller [candidate] (4.193 ms) : 0, 4193
IAST [baseline] (26.948 ms) : 0, 26948
IAST [candidate] (26.571 ms) : 0, 26571
section profiling
ProfilingAgent [baseline] (107.008 ms) : 0, 107008
ProfilingAgent [candidate] (108.467 ms) : 0, 108467
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (721.003 ms) : 0, 721003
BytebuddyAgent [candidate] (726.312 ms) : 0, 726312
GlobalTracer [baseline] (216.917 ms) : 0, 216917
GlobalTracer [candidate] (218.8 ms) : 0, 218800
AppSec [baseline] (33.13 ms) : 0, 33130
AppSec [candidate] (33.525 ms) : 0, 33525
Debugger [baseline] (7.247 ms) : 0, 7247
Debugger [candidate] (6.53 ms) : 0, 6530
Remote Config [baseline] (698.257 µs) : 0, 698
Remote Config [candidate] (700.846 µs) : 0, 701
Telemetry [baseline] (15.811 ms) : 0, 15811
Telemetry [candidate] (16.692 ms) : 0, 16692
Flare Poller [baseline] (4.208 ms) : 0, 4208
Flare Poller [candidate] (4.284 ms) : 0, 4284
Profiling [baseline] (108.138 ms) : 0, 108138
Profiling [candidate] (109.886 ms) : 0, 109886
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1019350
Total [baseline] (8.64 s) : 0, 8640271
Agent [candidate] (1.016 s) : 0, 1015667
Total [candidate] (8.62 s) : 0, 8619989
section iast
Agent [baseline] (1.152 s) : 0, 1152189
Total [baseline] (9.264 s) : 0, 9263775
Agent [candidate] (1.151 s) : 0, 1151016
Total [candidate] (9.262 s) : 0, 9261652
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent iast 1.152 s 132.839 ms (13.0%)
Total tracing 8.64 s -
Total iast 9.264 s 623.504 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.016 s -
Agent iast 1.151 s 135.349 ms (13.3%)
Total tracing 8.62 s -
Total iast 9.262 s 641.663 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (696.197 ms) : 0, 696197
BytebuddyAgent [candidate] (693.712 ms) : 0, 693712
GlobalTracer [baseline] (241.945 ms) : 0, 241945
GlobalTracer [candidate] (241.967 ms) : 0, 241967
AppSec [baseline] (32.819 ms) : 0, 32819
AppSec [candidate] (32.668 ms) : 0, 32668
Debugger [baseline] (6.467 ms) : 0, 6467
Debugger [candidate] (6.452 ms) : 0, 6452
Remote Config [baseline] (693.253 µs) : 0, 693
Remote Config [candidate] (689.132 µs) : 0, 689
Telemetry [baseline] (9.247 ms) : 0, 9247
Telemetry [candidate] (9.2 ms) : 0, 9200
Flare Poller [baseline] (9.441 ms) : 0, 9441
Flare Poller [candidate] (8.532 ms) : 0, 8532
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (816.016 ms) : 0, 816016
BytebuddyAgent [candidate] (814.726 ms) : 0, 814726
GlobalTracer [baseline] (231.958 ms) : 0, 231958
GlobalTracer [candidate] (231.781 ms) : 0, 231781
AppSec [baseline] (35.344 ms) : 0, 35344
AppSec [candidate] (35.62 ms) : 0, 35620
Debugger [baseline] (6.123 ms) : 0, 6123
Debugger [candidate] (6.143 ms) : 0, 6143
Remote Config [baseline] (602.637 µs) : 0, 603
Remote Config [candidate] (603.952 µs) : 0, 604
Telemetry [baseline] (8.565 ms) : 0, 8565
Telemetry [candidate] (8.614 ms) : 0, 8614
Flare Poller [baseline] (4.198 ms) : 0, 4198
Flare Poller [candidate] (4.259 ms) : 0, 4259
IAST [baseline] (26.699 ms) : 0, 26699
IAST [candidate] (26.653 ms) : 0, 26653
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759855769 1759860150
git_commit_sha 2aad71f fb58abe
release_version 1.55.0-SNAPSHOT~2aad71fc17 1.54.0-SNAPSHOT~fb58abe9c7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759861780 1759861780
ci_job_id 1167874587 1167874587
ci_pipeline_id 78635384 78635384
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-tzqpp5ok 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-tzqpp5ok 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load worse
[+106.465µs; +216.557µs] or [+2.482%; +5.049%]		 unstable
[-160.643op/s; +84.143op/s] or [-15.015%; +7.865%]		 4.450ms 1031.625op/s 4.289ms 1069.875op/s
scenario:load:insecure-bank:profiling:high_load worse
[+326.651µs; +632.348µs] or [+3.846%; +7.446%]		 unstable
[-98.386op/s; +41.011op/s] or [-18.023%; +7.513%]		 8.972ms 517.219op/s 8.493ms 545.906op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.836ms; +2.668ms] or [+4.264%; +6.195%]		 unstable
[-13.459op/s; +2.634op/s] or [-12.391%; +2.425%]		 45.319ms 103.200op/s 43.067ms 108.612op/s
scenario:load:petclinic:profiling:high_load worse
[+1.203ms; +2.172ms] or [+2.476%; +4.471%]		 unstable
[-10.276op/s; +3.851op/s] or [-10.670%; +3.999%]		 50.272ms 93.088op/s 48.585ms 96.300op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.289 ms) : 4237, 4340
.   : milestone, 4289,
iast (9.768 ms) : 9605, 9931
.   : milestone, 9768,
iast_FULL (14.506 ms) : 14215, 14797
.   : milestone, 14506,
iast_GLOBAL (10.691 ms) : 10495, 10887
.   : milestone, 10691,
profiling (8.493 ms) : 8358, 8627
.   : milestone, 8493,
tracing (7.614 ms) : 7499, 7729
.   : milestone, 7614,
section candidate
no_agent (4.45 ms) : 4399, 4501
.   : milestone, 4450,
iast (10.094 ms) : 9922, 10265
.   : milestone, 10094,
iast_FULL (13.996 ms) : 13717, 14275
.   : milestone, 13996,
iast_GLOBAL (10.496 ms) : 10310, 10682
.   : milestone, 10496,
profiling (8.972 ms) : 8823, 9121
.   : milestone, 8972,
tracing (7.672 ms) : 7555, 7788
.   : milestone, 7672,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.289 ms [4.237 ms, 4.34 ms] -
iast 9.768 ms [9.605 ms, 9.931 ms] 5.48 ms (127.8%)
iast_FULL 14.506 ms [14.215 ms, 14.797 ms] 10.218 ms (238.2%)
iast_GLOBAL 10.691 ms [10.495 ms, 10.887 ms] 6.402 ms (149.3%)
profiling 8.493 ms [8.358 ms, 8.627 ms] 4.204 ms (98.0%)
tracing 7.614 ms [7.499 ms, 7.729 ms] 3.326 ms (77.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.45 ms [4.399 ms, 4.501 ms] -
iast 10.094 ms [9.922 ms, 10.265 ms] 5.644 ms (126.8%)
iast_FULL 13.996 ms [13.717 ms, 14.275 ms] 9.546 ms (214.5%)
iast_GLOBAL 10.496 ms [10.31 ms, 10.682 ms] 6.046 ms (135.9%)
profiling 8.972 ms [8.823 ms, 9.121 ms] 4.522 ms (101.6%)
tracing 7.672 ms [7.555 ms, 7.788 ms] 3.221 ms (72.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.51 ms) : 37210, 37811
.   : milestone, 37510,
appsec (48.517 ms) : 48078, 48956
.   : milestone, 48517,
code_origins (43.067 ms) : 42691, 43442
.   : milestone, 43067,
iast (45.607 ms) : 45219, 45995
.   : milestone, 45607,
profiling (48.585 ms) : 48145, 49025
.   : milestone, 48585,
tracing (45.095 ms) : 44703, 45486
.   : milestone, 45095,
section candidate
no_agent (36.675 ms) : 36387, 36964
.   : milestone, 36675,
appsec (48.487 ms) : 48061, 48913
.   : milestone, 48487,
code_origins (45.319 ms) : 44922, 45716
.   : milestone, 45319,
iast (44.47 ms) : 44091, 44848
.   : milestone, 44470,
profiling (50.272 ms) : 49812, 50733
.   : milestone, 50272,
tracing (44.166 ms) : 43794, 44537
.   : milestone, 44166,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.51 ms [37.21 ms, 37.811 ms] -
appsec 48.517 ms [48.078 ms, 48.956 ms] 11.007 ms (29.3%)
code_origins 43.067 ms [42.691 ms, 43.442 ms] 5.556 ms (14.8%)
iast 45.607 ms [45.219 ms, 45.995 ms] 8.097 ms (21.6%)
profiling 48.585 ms [48.145 ms, 49.025 ms] 11.075 ms (29.5%)
tracing 45.095 ms [44.703 ms, 45.486 ms] 7.585 ms (20.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.675 ms [36.387 ms, 36.964 ms] -
appsec 48.487 ms [48.061 ms, 48.913 ms] 11.812 ms (32.2%)
code_origins 45.319 ms [44.922 ms, 45.716 ms] 8.643 ms (23.6%)
iast 44.47 ms [44.091 ms, 44.848 ms] 7.794 ms (21.3%)
profiling 50.272 ms [49.812 ms, 50.733 ms] 13.597 ms (37.1%)
tracing 44.166 ms [43.794 ms, 44.537 ms] 7.49 ms (20.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759855769 1759860150
git_commit_sha 2aad71f fb58abe
release_version 1.55.0-SNAPSHOT~2aad71fc17 1.54.0-SNAPSHOT~fb58abe9c7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759862320 1759862320
ci_job_id 1167874588 1167874588
ci_pipeline_id 78635384 78635384
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-14ez74hs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-14ez74hs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.556 s) : 15556000, 15556000
.   : milestone, 15556000,
appsec (15.116 s) : 15116000, 15116000
.   : milestone, 15116000,
iast (18.53 s) : 18530000, 18530000
.   : milestone, 18530000,
iast_GLOBAL (17.911 s) : 17911000, 17911000
.   : milestone, 17911000,
profiling (15.14 s) : 15140000, 15140000
.   : milestone, 15140000,
tracing (15.128 s) : 15128000, 15128000
.   : milestone, 15128000,
section candidate
no_agent (15.585 s) : 15585000, 15585000
.   : milestone, 15585000,
appsec (15.082 s) : 15082000, 15082000
.   : milestone, 15082000,
iast (18.55 s) : 18550000, 18550000
.   : milestone, 18550000,
iast_GLOBAL (18.082 s) : 18082000, 18082000
.   : milestone, 18082000,
profiling (14.913 s) : 14913000, 14913000
.   : milestone, 14913000,
tracing (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.556 s [15.556 s, 15.556 s] -
appsec 15.116 s [15.116 s, 15.116 s] -440.0 ms (-2.8%)
iast 18.53 s [18.53 s, 18.53 s] 2.974 s (19.1%)
iast_GLOBAL 17.911 s [17.911 s, 17.911 s] 2.355 s (15.1%)
profiling 15.14 s [15.14 s, 15.14 s] -416.0 ms (-2.7%)
tracing 15.128 s [15.128 s, 15.128 s] -428.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.585 s [15.585 s, 15.585 s] -
appsec 15.082 s [15.082 s, 15.082 s] -503.0 ms (-3.2%)
iast 18.55 s [18.55 s, 18.55 s] 2.965 s (19.0%)
iast_GLOBAL 18.082 s [18.082 s, 18.082 s] 2.497 s (16.0%)
profiling 14.913 s [14.913 s, 14.913 s] -672.0 ms (-4.3%)
tracing 15.006 s [15.006 s, 15.006 s] -579.0 ms (-3.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~fb58abe9c7, baseline=1.55.0-SNAPSHOT~2aad71fc17
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.696 ms) : 3481, 3911
.   : milestone, 3696,
iast (2.219 ms) : 2155, 2283
.   : milestone, 2219,
iast_GLOBAL (2.268 ms) : 2204, 2333
.   : milestone, 2268,
profiling (2.089 ms) : 2036, 2143
.   : milestone, 2089,
tracing (2.044 ms) : 1994, 2095
.   : milestone, 2044,
section candidate
no_agent (1.493 ms) : 1481, 1505
.   : milestone, 1493,
appsec (3.762 ms) : 3542, 3983
.   : milestone, 3762,
iast (2.232 ms) : 2168, 2296
.   : milestone, 2232,
iast_GLOBAL (2.266 ms) : 2202, 2330
.   : milestone, 2266,
profiling (2.127 ms) : 2071, 2183
.   : milestone, 2127,
tracing (2.041 ms) : 1991, 2091
.   : milestone, 2041,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 3.696 ms [3.481 ms, 3.911 ms] 2.215 ms (149.6%)
iast 2.219 ms [2.155 ms, 2.283 ms] 738.047 µs (49.8%)
iast_GLOBAL 2.268 ms [2.204 ms, 2.333 ms] 787.437 µs (53.2%)
profiling 2.089 ms [2.036 ms, 2.143 ms] 608.485 µs (41.1%)
tracing 2.044 ms [1.994 ms, 2.095 ms] 563.519 µs (38.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.493 ms [1.481 ms, 1.505 ms] -
appsec 3.762 ms [3.542 ms, 3.983 ms] 2.269 ms (152.0%)
iast 2.232 ms [2.168 ms, 2.296 ms] 739.049 µs (49.5%)
iast_GLOBAL 2.266 ms [2.202 ms, 2.33 ms] 772.809 µs (51.8%)
profiling 2.127 ms [2.071 ms, 2.183 ms] 634.036 µs (42.5%)
tracing 2.041 ms [1.991 ms, 2.091 ms] 547.934 µs (36.7%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 30, 2025 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759335243 1759336284
git_commit_sha 6c26663 1508bd9
See matching parameters
Baseline Candidate
ci_job_date 1759337570 1759337570
ci_job_id 1157962459 1157962459
ci_pipeline_id 78102352 78102352
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume unsure
[-10093.358op/s; -1381.745op/s] or [-3.363%; -0.460%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@pr-commenter
Copy link

pr-commenter bot commented Oct 1, 2025 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759335243 1759336284
git_commit_sha 6c26663 1508bd9
See matching parameters
Baseline Candidate
ci_job_date 1759337449 1759337449
ci_job_id 1157962457 1157962457
ci_pipeline_id 78102352 78102352
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@sarahchen6 sarahchen6 marked this pull request as ready for review October 7, 2025 20:51
@sarahchen6 sarahchen6 requested review from a team as code owners October 7, 2025 20:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/ci-app-libraries-java

@sezen-datadog sezen-datadog Awaiting requested review from sezen-datadog sezen-datadog is a code owner automatically assigned from DataDog/asm-java

@bric3 bric3 Awaiting requested review from bric3

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD Awaiting requested review from AlexeyKuznetsov-DD

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sarahchen6